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. treatment-unobserved, in which seven teachers.were instructed in the : 
*22 principles bat weré not subsequently observed; and . 
_contrdél-okserved. The results indicated that the treatment group 
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should be Inferred. Zee aoe . 
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afd: by Contract NIE~C-74-0089,; Correlates of Effective’ Teaching. The opinions 


° 


coresente) here are the comparisons of reading scores mer ‘in treatment a % 


‘and control classrooms. Future. reports will discuss the relationships ; 


.Backg kground of ite ey . , ‘ * ‘ is yA 


¢ 
_ Southwest Educational Development . Laboratory, 1973) which suggested - 


Grade Reading Group Study was an n attempt to verify the ‘usefulness of these 


oe at this grade level. Reading is. taught In all first grade chRssrocen, na, 


although there have been recent trends toward individual ized instruction, 


a 


. 


This. paper is. the first ‘In a serles of reports about the, First Grade, ; og 
Reading Group Study. As further analyses are SORPIRTRG fiture. reports 


will, expand on these finding’ and relate them ‘to other data. The results: 


between these’ gains and Implementation data based on classroom observations. — 
« d oi ry an 


FT 


i The purpose 68 ‘the First Grade Reading dot Study. was to‘ determine 
the ef fect iveness of 22 principles of "sa I-droup Instruction of young. 


chi luren, “These ‘spiaciwies were selected on i bast’ of previous corre- 


latlonat research (Brophy & Evertson, 1976) dad rogram development efforts 


promising approaciies “to Yeaching young’ chi Idren in small group settings. - 


Since much of the! Bretole research was corelatTonal In nature, the First. ~ 


principles fn an experimental situatton.: 


The first grade reading group setting was pied because of ‘the age 


of ba “children (previous research dealt with preschool and early elementary 


teaching) and: the fact” that this instructional format is nearly Sistsausar 


? 


Lia first grade reatiing Instruction still i of fered in the context of, 


am 


athe abt | Ity-based smal | group. Therefore, findings from this, study ad 


‘be useful +0" the large body of teachers who use this Instructional er 


an fendi beginning reading. 


= i" Pa a Fs The Study was a direct outgrowth of The ae Teacher ‘Effectiveness t 

Study (Brophy & Evertson, 1976). 2 eee findings ‘of Atte earMer study : 

* were based on classroom observations of. secdnid ‘and third grade teachers - 
who: varied in their’ teaching effectiveness as measured by residual ized 


gain scores on achievement tests ‘aiven to thet ‘students annua! ly. over a 


four-year period. . These teachers" behaviors oF correlated with thee 

a effectiveness scores a0 igntity teaching behaviors which were associated | oa 
with student ikeinine. gains. The pauls muagersted: several, directions: s 
for future. experimental research and. the present: study was an effort to | 
= ; : examine some of these behaviors. within an experimental framework. © The cor= 
“relational findings could not be interpreted as cousative tn nature: Ci, Chr 
* one. éould not concl ade that the teaching behaviors caused learning nein in 

‘ ‘the students), although “the * lng eat ons wore strong. However, an ‘nian 
: . vention studyt nvolving ‘encouraging ‘teachers to do cortain things and then 
measuring the: relationships of those behavlors to ‘tearntag would be a much 


‘ stronger indicat ton of causal relationships between teaching behaviors cai 


é Yo : ‘ ' : 
e student: outcones.. a: weed re 
” : # + Analysis of the correlational researth relating to smal group ‘teaching 
BE me al ear: t9 the deve lopment of an instruct tonal, ‘mode | ‘consisting ones pringiples. 


a t Analyses of the date, ‘ol lected tn. this: study wi UH examine the. effects of 
o : “fhe mode| as a. suhoie’ as well oe of ite. 22 components. * oe ee , j 
The 22 erivetples® deal only with teacher behav Hlor-in ‘managing instruct fin 

a 7 in the smal | group setting. ‘Thus, they are "curriculum free." They could: 

< ¢ be adapted to any treading series or . Instructional Bop ens ‘chosen by the - x . 


| 
. teacher, so long 5 Instruction was conducted: within the traditional small i Ag 


group context. ‘The éecher could follow these techniques and also conform - ao 2 


Oy 4 ~ 5 , 2% 


ov * 


te th saeEL ION fo) foro in the teachers! manuals about sete of 


‘ 


the orfacloles ere brasutead into bis major sections: (1) organization 


GETTING THE SHI LDREN'S - “ATTENTION . 
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3. The teacher introduces the lesson with a brief overview. <= : 
4, , The teacher presents: new words. clearly, : 7 ' . 
5. After presenting new words, the teacher has ‘the chi ldren repeat them. ' 
6. 7A ‘denonstrat ion or explanation precedes ‘the, chitovaate attempts 40 


ss ° . ° é e : wee 


8. The Paschar should call on children in order rather 7ua8 randomly. 


9. Occasional ty, the. teacher should question a: éhi td ‘cyt another chi id! 5 


responses ‘(to keep everyone alert). : te 


—do'the work, Y Pie ae get a 
w : az ; y- Cae : . ¥, Soe : : _ * 
CALLING ON CHILDREN ; cee ane : a : 
7. The HORCNEr should work with ‘one child Id af! a tine, _ SO >that everyone js _ ‘ 
' checked. and recelves feedback. : ae. “5 


, 


; each chi Id jis: “responsible. for the question asked of filis 


together, -making sure that everyone masters aor step before moving -on to ' ; 


‘ 


: - 2 ) 
. %. ¥ , 
a a“ ° ’ 
a 
\ at la ‘ 4 
~ \ ~ ~ 
¢. «% : ; ; . 
© Be wey 4 
; - % - one rr Ny 
10, The’ teacher should minimize calling on volunteers, one: 


‘ 
: 


He ‘The: teacher Sheets Mscniteas: call outs and should enphas ize that 


. 
ay 


Roe op: a 
2s The teacher should avoid shetor ical questions, answering er own 


\ < . - 
ae Sat 


questions, or repeating questi ons. These confuse the’ children. ‘ ’ 


. 


MEETING INDIVIDUAL LEARNING NEEDS WITHIN THE GROUP 


. 


. 


i3. At some point, the teacher must decide If ‘the: whole group can meet. ae 


lesson's obiectives. lt she decides they a she- should hold the group” 


the next step, we oe »* 


a a 


14, If the teacher decides that everyons cannot feat the cosecnive, the 


_ Students who can do SO y Should be taught Thpeagh to the end and then 4 


a 
dismissed, so that the teacher can Spend tore tine with the other chi Idren. = 


15;  Ayexception to The ‘above oceurs when the teacher" Saute to use as 


’ ( i. 


student who has wastered the objective as a model for the others. - “Hieay on 
4 $ 
\ res 
she may retain one or-more such students In the group In order to carry 
_« Sidon ' ae, ane: oe * ' . 
_on a dialogue. ar 6: 


16. , If some of the children do not succeed in meet ing. the objeetives before 
lesson time is’ up, arrangements should be made for extra tutorial: help. 


° : - : i y = 
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Me RESPONDING TO ia ke ANSWERS — 


e ¢ 


* 


‘The beabher! Ss feedback 7 children's answers depends on (1) the type 


of question ‘(whether it Heavies memory. -or reasoning), (2) the pace of a 


s “ i 


a 


* questioning. (whether: rapid for drill or slower for more thoughtful questions), 


‘ i . i 


at 


te 


: r . rer ; 
: c - # 
ant: (3) the child's answer (correct,. incorrect, "I don't know," or no 
. . ES aa + 
' response). iy re . d.. 
{ A e ‘ ; " 
i : . ‘. és . ny J : Fe ¥ 
WHEN. THE CHILD DOES NOT RESPOND ar Y 
: : 17, After asking a question, the teacher waits for the chj ld to respond « 


| and ‘alSo. sées that other children walt and do not call out answers. ‘During 


’ ’ 


rapid pacing, she waits a few seconds and gives. the ‘answer. During the 


more’ slowly paced parts of.the lesson, tthe teacher should wait for an, . 
4 
answer as long gs. she eae that one child is thinking “id wit answer, 


BP ah“ 
Be ‘but not so: long as to siverreciite chi Id or lose the other chi \dren' s ' | 
attention 3. ‘ r 

{ \f the child does not respond within a.reasonable time, ‘the ‘teacher 


5 should indicate that some response is expected by probing ("Do you ' , 


know?"). She should then ‘simp lity (see #19) according to the type of 
question... 7 J 


ri WHEN THE CHILD'S ANSWER IS INCORRECT 
i é , u : . 
18. “They teacher should indicate that the answer is wrong, and then follow 


4 


, 


Spee Ee ee 


simp Lif tcation procedures out! ined below for the two ques: ‘questions. 


% SIMPLIFICATION PROCEDURES 
19. ' The appropriate simplification procedure is determined ®y the type 
* : . ~ ata “ — 

of question. .- - : ' ; aks ee 


a. of the question deals with factual knowledge that, cannot be — 


reasoned out, the teacher shania give.the answer to the child 


\ 


and theh move on. | es 2 fi he 


s 


M 


b.” If. the question is one that-the child could reagon out with 
‘help, the teacher shoud: provide clues or simplify the question. 
If the clues still do not help the child, he Showld be given ©. 
* the | answer ‘The téacher should néver ask another child to. 


~ , 


supply the answer. e “a: ’ r 


WHEN THE CHILD 1S CORRECT ee 4 


‘ 


20.. The etal should ‘acknowledge the correctness, and make sure’ that 


everyone else heard and understood the answer. ‘ 


. 
~ 


PRAISE AND CRITICISM 


’ 


243 Rraise Is ‘Important but should not be re eas Praise 
thinktng and effort more than just getting the a swer, and make i ad as 


specific and Individual: as ‘possible. - 


} 


22. Criticism should also be as “specific as possible and should Aiea 


specification of desirable or correct times 


a 


’ 


Method ‘ 


cy . 


Nine schools and 27 ton le first grade teachers, were involved in the 


sill ‘Scores of 557 stuGan s were included in. the analyses presented In 


me o 


this paper. 
All data were collected tn public elementary schools serving a < , 


predominately white population In Austin,. Texas. All classrooms were 


traditional in thelr first-grade reading group Instruction, In that 


a . 


oe om 


\ 
reading was taught. in. sna LU ability groups ‘in self-contained c'assrooms. 


Each of the nine, schools was described by the ceived district, as middle” 


rf 
s9¢ loeconomic gtates (SES) ," elias there, was a small range of 


variation within ‘this ctassIf gation, Therefore, the nine schools were 


divided into three groups which were matched for SES and maaan of 


“teachers, These three. groups were “then randomly assigned ‘to the ‘ 


oe water inane: groups. All participating ‘teachers within any given, 


. ro vere in the same exper Imenta | group. This neant that school 
st Sy 


is \rtects could interact with’ sreataant effects, but it el lini nated the 


prob lem of contamination af control teachers by exper inental teachers. 


> 


yt coe * The’ three groups were: 


; pe. Tr atment-obs 


oe “The 10 teachers in this group were 
‘Instructed’ in’ th 22 principles: and were observed: teaching their reading 
“groups approxima aly once a week for most, of the years (Student N= 192 
2, Treatnent-unobserved. The seven teachers In this group also 
were instructed in the 22 princip! oe but they. were not foserved during 
» the years (Student N = 147) - 
oF - . 3. ‘Gorttrol~observed: _ The A teachers In this observer-presence 
; group did. not’ receive any specific treatment. ° They were told that the ~ 
: researchers were interested fn learning about effective teaching bepaviors 
for first grade reading faaehibtiens They also were observed approximately 


= P . s 


once a week for most of the year. (Student N= 218) 


ays | . is 
ease ‘ ‘The last two groups were included In the. design to answer certain 


ae ‘to ‘deteriniae tf the treatment was effective without observation, The 
t 27-3 3 - y % sd . . 
. 


, questions: about the treatnent. The treatment-unobserved group was included 


e 2 


c . ‘ a . ; ¢ 
. 2 * ’ ri Fy . » * 
, . ‘i ‘ c $5 


oY 
santral, group was included to datermine $c what extent the’ principies 


were implemented naturally, “withouit- any: treatment. Because the instruc- 7 Be 


eee nada was developed by aigenany teachers and reigting thelr be~ : af 
is a : * 
aviors to: effectiveness, it was éxpected that nwst teachers would, already: ec 


—_—_ 


be using these, principles, in varying degrees. ‘Also, by. gathering i an Oe, 


observational data” on -the use se each principle, we would: ‘be able to look at. .: ; 


* ‘ ‘ 


process-product relationships across the tws observed groups to. determine 
\ 


each principle! s relative df fectiveness. That Is, we could “examine: 


certain. ah behaviors which were part of the large mode! Gu 


* calling on the chi idren In order’ rather than randomly) and assess: ‘helt 


ate indep ndent ly. of the ehiects of the model as a ce po ee 
told only: ‘sou “a4 

Nee 

{ 


* When* “they eachers pene contacted - initially, they w 


7 #: 
their asstoned ondition.- Therefore, they oe naive as to the a * 
; , ; 


1A uc at any ti eS ee 2 at < aeig : % a 
a , , The two treatment groups were given identical booklets, which explained 


tHe 22 principles an thé rationales beh, nd them. © . They were sncetiregee to a 


“h 


“use the techniques: in \their teaching Sesto the. ‘eee ‘but were assured 
that. they should use-Tt! eir own best “lade about how the techniques worked e 
with their children. ) further traifing with the principles was offered Yee 


fi ig the initial Alscussion, although the teachers kept the written ) 


" materials for reference. 


‘ - The ‘20 teachers who were ‘observed (the treatnent-observed, cand control. / "hg 


ly “ones a’ ) wae  Thetr reading groups were | 


Pe: ; 


‘ 
. wee : . ay Eee 
4 a. : ie ho Pie gd a a 


" groups) were seen approxima 


‘ 


“coded with an _observat ional systém designed for’ this study “Brophy; et: wales 


Peers 


"Note it ee This sytem inoasured for only imp lemenfation of the 22 principles, 


e- 
but also ia imediate, attacts ‘of ouchiot THES, For exampte, If the. teacher | 


“used a signa! to call a ‘group together, “the classroom observer would note 
: ., I. ~).: 7 a 
an note what kind of signal was: used, ‘and note how ettderive| its was in, ae ar 
“e | ' ee 
starts of. time spent In transition and attentién of the, Zhi Ideen to the © 


signal.* Other seks taken with the ays wi “be: used to evaluate ya 
4 a vw . : « a A s : 


: the principles further. afor example, - was the “frequency of call bits 


hia wh * 


higher or lower’ in open ich teachers used, patterned turns cater ay 
-~ . , “ ! e , 


' . ‘ ay 
a A 


than vol uneeeea® . Pie. s, 


. > ea 
hI XN 


\ All students in the School Isystem uy sive the Metropc Litan, Taaitiaal 


é 
Sot 
a 


+ Test \t the beginning of “the year. The scores were nade ava lable to us, 


, 
< ‘ 


ana they served as, cov {tants in the final analysis of gaing. | ‘At the, end 


of. ‘the year, the children in all of fe clagsrooms involved ak the study? 


4 ae Se Rage 0 
were ‘tested with, the, Metropoi {tan Achievement Test, Primary I level, Due 
\. to the setting of the stdy aa tine limitations, Snly the three subtests - Se gs 


} im) 


pertatnltg to reading were sivue -word iqemtasee, worg analysis, ‘and a ; 


t = , ; iY P ee: “ pikes 
know ledge and reading sbi 6 «< 2 3 7s < g ae ace 
In addition to. the testi g of, the‘ “hi Idren gd the “¢teigsroom obser . 


“peadtng. There also. was ack reading score"s computed from the word 2 : ( 


. e 


salliaaa other fata bee tectéd w re ratings 5f the teacher sand: students “sf 


. 


” ‘ 


deheher’ Mis which she rated Mr PP quency. of use of ‘each of the principles > ; 


,and gave. her opinton, bt si general “value and. pei advantage and dis- amy 


we ig NOES ; \ 
y ’ , 
. advantages. Sie: sari ss acer ty 
Ar ” i : a Fs : ‘4 ? 
A ; , A he . 
PSs ; > a @ » eas "yg e 
Jf — 3 
“ Ae : \ 
. . y : “ . ' é , 
; : _ A _ , , a 


wt > is Data Analyses ; # 
7” pa WAS . ‘ : *% 
‘ i ‘ ‘ 


a Pg For the pesutrs reported in this paper, the measures lof Jess are 


eis _ the protest: ra peettery scores of--the eit Idren qn each of ‘the three : 
F . abeon Bo 
, ; prestignt groups. Table. 2 presents the mean scores 4or “eh group. The AE = Ae. « aoa 
- two" measures were used = compute adjusted post scores. ee each of tour’ 


posttest measures for sack chl = using the readiness scores as co-var lables. 


; “A different set of ‘aradictons vas, used for gach subtest of the posttest 


measure (the Metropolitan Achlevenert Test), because yaitial analysis is 


@ 


"4 \ 
Bs revealéd that certain subtests of the Metrop tan Readiness Test were better p 


he / - 4 predictors of performance on certain of the subscores of the achievement, 


~ 


test Than were other readiness subtests. These ‘analyses Involved ven 
x Tne t 
rtial correlations with an pl ace _ 


oie 
, subtest’ were égnsidered the - neat sihilokos for. that measure. The: combination 


oaeetal correlations between each | readiness and ach Tevement siibe 
poe r" readiness subtests with santa, pa 


. ’ 


‘of best predictors was dif ferent for\each subtest of he Achievement Test, — 


e 


hives separately “for the four achievement subte ts, ‘ite 


so resu Its were. 


Mie ond i predictors used [for each ach tevement subtest and the partial r's are 


~ 


4 listed in Table’ ‘ 


ater anal ISeS of variance of the adjusted achievement scores 
of the, three grou s were. computed in two different ways, once using the 
557 asta s dores as the units of analysis, and once using the 27 
teachers" chal s mean’ adjusted achievement seoreg as the units of. analysis. 


EN 
yses yielded similar Pebults, but the Susy as done with 


. Both types” ‘ot 


students! As Produ d much higher ‘significance vu loss due to the. large an 


Pd 
erple size. Because the trea gil was administered ‘to the teachers rather |! 


° than to the students (aitough, sanavate im 


15 


ntation data are available 


4d 
h individual thild observed) and because ‘using teachers’ scores as 
/ the. cgi) of analysis is. more conservative, only the results: for +6 chers 
wil be “reported here. However, the analyses of “student scores served 
to strengthen the findings of ate analyses of teachers! ‘scores. Bi: 
tn addition to the three-group analyses of variance, post hoc deoun 
as ef compartsons were done in order to determine the source of signi fic nt 


‘Bo, differe a This was done by means of multiple regression equatjons in 
ee of treatment groups were examined for their contrtbution to 
the pie équation. That is, paired Groups | and 2, | and 3; -and 2 
. and 3 were ana lyzed Hy col bepehng group membership vectors within a 
i _ multiple. regression sais iors then ita restricted models were each = 
compared to a "full" model in which ‘each treatment group was separately 
\ assigned to binary predictor vectors. “This approach ts. descr ibed 
‘s " extensively in Ward and Jennings (1973). These analyses resulted in F- Pal 
fatios: which represented the difference in predictive aceuracy between / 
the’ ‘full models and the restricted models (in which the pairs of groups 


| =f 
were col lapsed). A signifidant.f, F Indicated that the restricted mode | 


‘ 


x & 


did not predict the ertterton ‘the “ad taied achievement scores) as wel | as a 


the full model did: This meant that. there was a significant difference 


, 


between the two groups which were characterized by a sing le predictor | 


, Vector in the restricted model. This approach Is similar to a one-way; two- oS 


bh 4 
\ group analysis of variance in which the null hypothesis of equality between 


i groups is tested, a: by using regression equations, the contribution of “" 
all three groups to the total: variance is taken into account in computing 


the F, so that the error term is reflective of total variance instead of 


only the within-group variance of the two groups in question. 


om, = 


Py ee 44 


Results 
., \ 


_ Analyses were done for each of the four posttest scores: word “know=- 


Pa 


led le, word analysis, reading, and: total - readings Due .to ‘the smal t* sample 

size\and predicted direction of differences, F values with p < .10 were 

congas? gai cath This is equivalent. to p < .05 for one-tailed tests. 
"The one-way, three group andlyses of vextencd indicated a significant: 


differ ce between the three groups 1 the first three measures, and an al- 


aE 


mos significant Bites for the total reading, gain scores. The means i 


and standard deviations oF the adjusted post scores of the three @ groups Gee 


J 


ES) . 


"are given in Table 3. The analvsis of variance source tables are presented 


in Table 4) ° : ‘7 v* _ 
t ¢ ee 


The group comparisons ylelded no migattloant differences on any 


’ oe 


measure between the “two treatment’ Groups. (observed an unobserved). When 


ra 


the treatment-observed group and the control group were compared, signi- 
' ficant differences were found on all measures except word analysis. Com- 


parisons ‘of the treatment-unobserved and ‘the control groups resulted in — 


s\: 


_ significant differs ices for all’ four measures. The F rattos and p levels 


of the group {pomp isons_are given, in Table 5. All differences were in 
pate n . a, 


the predicted direction: treatment groups outperformed the control group. 


fe 
° 


Discussion 


>The results indicate that the treatment group teachers produced greater , 


reading gains in their students than did\the control group teachers, and 


that the treatment effect was not moderated by the presence of observegix ° 


‘ 
! 


° 


_ In thesclassroom. 


* 
1 


# 


ee effort, these » 


r 


Considering that the treamcnt (4 itself was aalnine in terms of tratning & 


Sharleen differences nave immedi ate practical’ Importance, 
. They suggest that Implications of researchycan be implemented in the class 
~Fooin easily with measurable results. . oa i aoe eg, ad ; 
It Is tempting to present the instructional mode | as ‘the cause of : 
group dificrciwes, and to start peimnmaaltoaelt as an ettective, inexpensive, 


way .to. improve Instruction.in first grade reading. 


ark 


However, experience 
1 


+ 


in classrooms -has convinced us that-broad conclusions about, what is the 
— s 
"best approach *to teaching are seldom, if ever,’ accurate and suitable for 


fail children in a classroom. Therefore, rather than try to interpret To Le 
the results at this point as due to a simple "treatment effect," we: - : | : 
are presefting them as initial analyses which now may: be examined ‘In - ; 2 
greater detail. me 8 .* ' pS ae i es 

: ; ; : ont i we a "ks 
Further aedlysex will be RECS ENeS using the observational” date, the - of 


The fol lowing questions 


o @ 


observers? ratings, ‘se the teachers! Interviews’, 
= 


‘will’ be addressed in order to’ def ine exacT ly what prodiced the differences ro 


in performance between groups: . : 


‘ (1) What are the rélationships be fuecn id al the senitile parts 
of the instructional model 2 That is, do some teaching behaviors recommended — _* 
by the model have more of an effect than others? for example, ‘is it 
important to use\ sustaining feedback to errors butLnot important TO use 
a standard signal fer transitions or to use over jews? + 

(2) 


aspects of the insttuctional ‘mode! play a more i: portant-role in promoting 


Are there aptitude-treatment interact ns? THtattid selotecoore 7 : 
= i 

learning among lower-abi lity students than midd/le or high ability students? | 

For exainple, ts calling on chi Idren in order more important in low-level 

reading groups ‘than in ‘high-Jeve | reading groups? : si 


5 16 =e 


ee the groups other than treatment assign- Se 
‘game ESOS to prevent aahoatiaitans the possibility of ‘strong 
“school wighcis cannot be ruted out yet. 5° : — y, ‘ 
‘Answering such questions will yield’ more information about the os 
Siasshoom processes which are associated with learning gains th first ’ 


“grade reading. Until these questions are examined, confident conclusions 


i aad oa 


a r 
' Fo t 
(3) What are the effects of factors which were not specifically 


“méntioned in the instructional model but which were measured by obsér- 


‘vation, rating, or. interviewing? For example, were class stze, reading 


group ae, timé spent in reading group, teachers! overal| ganagement-.. ability, 
proportion of boys to girl's, or number of ‘saatwork sal iqawents fmore pre- 

dictive of reading’ gains than the: treatment: variables? _ Random assignment 

to > treatment “groups should have minimized differences between. teachers - . Fs 


in the thrée groups in these areas, but it’ is possible that there were ".4 


ment “Also, because all teachers within a school were Seeley to a a 


™ 


¢ 


s “ 


about the results would be premature. “However, the data analyses reported 


here suggest that a strong treatment. effect was present. If this is 


borne out by fol low-up analyses, the data will have important ‘implications 


nce { 
for early rea instruction. . a » 
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